Lie Algebraic Methods in Optimal Control of Stochastic Systems with Exponential-of-integral Cost

نویسنده

  • Charalambos D. Charalambous
چکیده

The purpose of this paper is to formulate and study the optimal control of partially observed stochastic systems with exponential-of-integral-sample cost, known as risk-sensitive problems, using Lie algebraic tools. This leads to the introduction of the su cient statistic algebra, Ls, through which one can determine a priori the maximum order of the controller. When dim(Ls) < 1, the construction of the control laws is addressed through extensions of the Wei-Norman method, as in nonlinear ltering problems. Aside from speci c known nite-dimensional examples which are studied in order to delineate the application of the Lie algebraic tools, new classes of nite-dimensional controllers are identi ed as well. In addition, relations with minimax dynamic games are explored to best assess the importance and generality of the nite-dimensional control systems.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Multi-Stage Single-Machine Replacement Strategy Using Stochastic Dynamic Programming

In this paper, the single machine replacement problem is being modeled into the frameworks of stochastic dynamic programming and control threshold policy, where some properties of the optimal values of the control thresholds are derived. Using these properties and by minimizing a cost function, the optimal values of two control thresholds for the time between productions of two successive nonco...

متن کامل

Risk Sensitive Path Integral Control

Recently path integral methods have been developed for stochastic optimal control for a wide class of models with non-linear dynamics in continuous space-time. Path integral methods find the control that minimizes the expected cost-to-go. In this paper we show that under the same assumptions, path integral methods generalize directly to risk sensitive stochastic optimal control. Here the method...

متن کامل

Inverse Optimal Controller Design for Strict-feedback Stochastic Systems with Exponential-of-integral Cost

For a class of nonlinear stochastic systems in strict-feedback form, where the diffusion coefficients depend on the state, we obtain risk-sensitive state-feedback controllers which are both globally inverse optimal and locally sub-optimal. These controllers also lead to closed-loop system trajectories that are bounded in probability.

متن کامل

The Exact Solution of Min-Time Optimal Control Problem in Constrained LTI Systems: A State Transition Matrix Approach

In this paper, the min-time optimal control problem is mainly investigated in the linear time invariant (LTI) continuous-time control system with a constrained input. A high order dynamical LTI system is firstly considered for this purpose. Then the Pontryagin principle and some necessary optimality conditions have been simultaneously used to solve the optimal control problem. These optimality ...

متن کامل

Classification of Lie Subalgebras up to an Inner Automorphism

In this paper, a useful classification of all Lie subalgebras of a given Lie algebraup to an inner automorphism is presented. This method can be regarded as animportant connection between differential geometry and algebra and has many applications in different fields of mathematics. After main results, we have applied this procedure for classifying the Lie subalgebras of some examples of Lie al...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1999